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ABSTRACT 



The National Household Education Survey (NHES) is a data 
collection effort of the National Center for Education Statistics that 
collects and publishes data on the condition of education in the United 
States. The NHES is designed to provide information on issues that are best 
addressed by contacting households rather than institutions. It is a 
telephone survey of the civilian, noninstitutionalized population that 
collects repeated measurements of the same phenomena at different times. This 
paper presents information on the unit response rates, item response rates, 
and imputation. The first section, "Unit Response Rates," describes response 
and completion rates for the NHES: 95. It includes information on rates for 
the Screener interview and the extended Early Childhood Participation and 
Adult Education interviews. These topics were the focus of NHES: 95. Some 
14,064 children were sampled for the Early Childhood component, and 3,569 
adults completed the Adult Education interview. "Item Response and 
Imputation" discusses the approach taken to missing responses. As in most 
surveys, responses to some data items were not obtained for all interviews. 
The imputation of missing data is discussed. "Weighting and Standard Error 
Calculation Procedures" describes the procedures for producing the weights to 
estimate characteristics from the NHES: 95 sample and to estimate sampling 
errors for those estimates. Methods for estimation were developed that were 
consistent with changes from the original weighting plan made during the 
collection period. (Contains 27 tables and 8 references.) (SLD) 
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Consequently, we encourage users of the series to consult the individual authors for citations. 

To receive information about submitting manuscripts or obtaining copies of the series, 
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Overview of the National Household Education Survey 



The National Household Education Survey (NHES) is a data collection system of the National 
Center for Education Statistics (NCES), which has as its legislative mission the collection and publication 
of data on the condition of education in the Nation. The NHES is specifically designed to support this 
mission by providing information on those educational issues that are best addressed by contacting 
households rather than schools or other educational institutions. The NHES provides descriptive data on the 
educational activities of the U.S. population and offers policymakers, researchers, and educators a variety of 
statistics on the condition of education in the United States. 

The NHES is a telephone survey of the noninstitutionalized civilian population of the U.S. 
Households are selected for the survey using random digit dialing (RDD) methods, and data are collected 
using computer-assisted telephone interviewing (CATI) procedures. 45,000 to 64,000 households are 
screened for each administration, and individuals within households who meet predetermined criteria are 
sampled for more detailed or extended interviews. The data are weighted to permit estimates of the entire 
population. The NHES survey for a given year typically consists of a Screener, which collects household 
composition and demographic data, and extended interviews on two substantive components addressing 
education-related topics. In order to assess data item reliability and inform future NHES surveys, each 
administration also includes a subsample of respondents for a reinterview. 

The primary purpose of the NHES is to conduct repeated measurements of the same phenomena at 
different points in time, although one-time surveys on topics of interest to the Department of Education may 
also be conducted. Throughout its history, the NHES has collected data in ways that permit estimates to be 
tracked across time. This includes repeating topical components on a rotating basis in order to provide 
comparative data across survey years. In addition, each administration of the NHES has benefited from 
experiences with previous cycles, resulting in enhancements to the survey procedures and content. Thus, 
while the survey affords the opportunity for tracking phenomena across time, it is also dynamic in 
addressing new issues and including conceptual and methodological refinements. 

A new design feature of the NHES program implemented in the NHES:96 is the collection of 
demographic and educational information on members of all screened households, rather than just those 
households potentially eligible for a topical component. In addition, this expanded screening feature 
includes a brief set of questions on an issue of interest to education program administrators or policymakers. 
The total Screener sample size is sufficient to produce state estimates of household characteristics for the 
NHES-.96. 

The NHES has been conducted in 1991, 1993, 1995, and 1996. Topics addressed by the NHES:91 
were early childhood education and adult education. The NHES:93 collected information about school 
readiness and school safety and discipline. The 1991 components were repeated for the NHES:95, 
addressing early childhood program participation and adult education. Both components underwent 
substantial redesign to incorporate new issues and develop new measurement approaches. In the NHES:96, 
the topical components are parent/family involvement in education and civic involvement. The NHES:96 
expanded screening feature includes a set of questions on public library use. 

In addition to its topical components, the NHES system has also included a number of 
methodological investigations. These have resulted in technical reports and working papers covering 



diverse topics such as telephone undercoverage bias, proxy reporting, and sampling methods. This series of 
technical reports and working papers provides valuable information on ways of improving the NHES. 

This working paper presents information on the unit response rates, item response rates and 
imputation, and weighting procedures in the 1995 National Household Education Survey (NHES:95). 
Readers may also wish to review the other NHES:95 working papers: Design, Data Collection, Survey 
Administration Time, and Data Editing in the 1995 National Household Education Survey (Collins et al. 
forthcoming). The 1995 National Household Education Survey: Reinterview Results for the Adult Education 
Component (Brick et al. 1996), Undercoverage Bias in Estimates of Characteristics of Adults and 0- to 2- 
Year-Olds in the 1995 National Household Education Survey (Brick et al. forthcoming), and Comparison of 
Estimates from the 1995 National Household Education Survey (Kim et al. forthcoming) for additional 
information on the survey. Comparable working papers are also being prepared for the NHES:96. 



1995 National Household Education Survey 
Unit Response Rates 



Introduction 

This section describes the response and completion rates for the NHES:95. It includes data on the 
rates for the Screener interview, the extended Early Childhood Participation (ECPP) interview, and the 
Adult Education (AE) interviews. The following presentation is based on the assumption that the reader is 
familiar with the survey design and, to a lesser extent, the weighting procedures used in the NHES:95. 
The weighting procedures are discussed in a later section of this working paper. 

Because there are a number of ways to describe the outcomes of the data collection activities of a 
random-digit-dial (RDD) telephone survey, the next section provides an introduction to the terms 
"response rate" and "completion rate" as used in this document and for NHES:95 in general. The results 
for the NHES:95 follow these introductory remarks. 

Definition of Response and Completion Rates 

A response rate is the ratio of the number of units with completed interviews (the units could be 
telephone numbers, households, or persons) to the number of units sampled and eligible for the interview. 
In some cases, these rates are easily defined and implemented, while in other cases the numerators or 
denominators of the ratio must be estimated. 

For reporting the results from the NHES:95, the response rate indicates the percentage of possible 
interviews that have been completed taking all sampling stages into account, while the completion rate 
measures the percentage of interviews completed for a specific stage of the survey. For example, 
household members are identified for extended interviews in a two-stage process. Screener interviews are 
conducted to enumerate and sample household members, and then extended questionnaires are 
administered to the sampled members. If the responding household member fails to complete the first- 
stage Screener, the extended interview cannot be conducted in the household. In this case, the completion 
rate for the second stage is the percentage of sampled persons with completed extended interviews. The 
response rate is the product of the first- and second-stage completion rates. 

Response and completion rates can be either unweighted or weighted. The unweighted rate, 
computed using the raw number of cases, provides a useful description of the success of the operational 
aspects of the survey. The weighted rate, computed by summing the weights (usually the reciprocals of 
the probability of selecting the units) for both the numerator and denominator, gives a better description of 
the success of the survey with respect to the population sampled. Both rates are usually similar unless the 
probabilities of selection and the response rates in the categories with different selection probabilities vary 
considerably. All of the response rates discussed in the report are weighted unless noted specifically in 
the text. 

Response rates and completion rates are identical for the first stage of sampling and interviewing 
(i.e., the Screener). The next section discusses the response rate for the Screener and provides a profile 
of the characteristics of the respondents. The discussion of response and completion rates for the extended 
interviews and response profiles for these interviews follows. (All tables mentioned in the following 
discussion are located at the end of this section, beginning on page 15.) 
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Screener Response Rates 



The first panel of table 1 shows the disposition of the 120,459 telephone numbers that were 
sampled for the NHES:95. The three major categories of response status are those identified as numbers 
for residential households, those identified as nonresidential numbers (primarily nonworking and business 
telephone numbers), and those numbers that, despite numerous attempts, could not be identified as 
residential or nonresidential. 



About 50 percent of the telephone numbers were identified as residential. This percentage is lower 
than in previous NHES studies, which averaged about 60 percent, but this difference was expected 
because the NHES:95 is the first of these surveys conducted using a list-assisted methodology. One of the 
features of this method is that the expected percentage of all telephone numbers that are residential is 
lower than in the Mitofsky-Waksberg two-stage samples that were used in previous studies. Assuming 
that 40 percent of the telephone numbers with unknown residential status are residential (discussed below), 
the percentage of numbers that are residential is 52 percent, close to the 53 percent that was expected 
prior to the start of the survey. 
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The percentage of telephone numbers with unknown residential status was 5.5 percent, which is 
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One possible explanation is that the frame of telephone numbers created using the list-assisted method may 
contain more telephone numbers that cannot be identified as residential despite numerous telephone calls. 
Since virtually all of the unknown residential status numbers were called 14 times or more the large 
percentage in this category is not the result of fewer calls to the numbers. 



The second panel of table 1 shows four estimated response rates for the Screener based upon 
different assumptions about the telephone numbers. Each of these rates is described below, along with the 
rationale for its use. The primary difference across the rates is in the allocation of the numbers in the 
unknown residential status category. 

The business office method derives its name from the technique used to estimate the denominator 
of the rate. After drawing a random sample of the telephone numbers with unresolved residency status (a 
sample of 350 numbers from the 5,172 that were never answered by a person or an answering machine 
and 250 numbers from the 1,443 that were never answered by a person, but were picked up by an 
answering machine at least once), the numbers were classified as either residential or nonresidential by 
calling local telephone companies for the numbers from exchanges handled by those companies. This 
check with business offices, explained further in the next paragraph, was conducted in April of 1995 at the 
conclusion of the survey. 



The telephone companies were contacted by telephone experienced Telephone Research Center 
supervisors and asked to classify the numbers as working or not working. If they were working, the 
companies were asked to further identify them as residential or business numbers. No information was 
obtained for 53 of the 600 numbers because the representatives of the telephone companies said they did 
not have the data to classify the number as residential, business, or nonworking. 

The percentage of the 6,615 numbers that were residential was estimated in the following steps. 
First, the 53 numbers that had no information were excluded and the percentage of numbers that were 
working was computed (84 percent for the numbers that were never answered by a machine and 87 
percent for those that were). Second, the percentage of working numbers that were residential was 



estimated by excluding those numbers for which the residential status was unknown. (Among numbers 
with known statuses, 41 percent of working numbers never answered by machines were residential and 73 
percent of working numbers that were answered by machines were residential.) Third, the percentage 
residential was estimated by multiplying these two percentages together (84% x 41% =34% for numbers 
never answered by machines; 87% x 73% =63% for numbers that were answered by machines). 

As a result of this process, it is estimated that 40.5 percent of the numbers were residential (34 
percent of the numbers that were never picked up by an answering machine and 63 percent of those that 
were). This result is nearly identical to the result from a study conducted at the end of the NHES:91. 
Therefore, the denominator of the business office method is all the telephone numbers that were known to 
be residences plus 40.5 percent of the numbers with unresolved residential status [62,392 
=59,713+(0.405 x 6,615)]. The numerator is the number of telephone numbers in households that 
participated in the survey (45,465). 

The estimated Screener response rate using the business office method is 73 percent. If the raw 
count of telephone numbers was not weighted, the Screener response rate using the business office method 
would also have been 73 percent. The estimated Screener response rate of 73 percent is recommended for 
general use, and it is used in all the subsequent presentations of the data from the NHES:95. 

The other three response rates shown in table 1 were computed by allocating different proportions 
of the numbers with unknown residency status into the residential category. The CASRO (Council of 
American Survey Research Organizations) rate is computed by allocating the numbers with unknown 
residential status in the same proportion observed in the numbers with known residential status. Since 
evidence from the sample described above suggests that the residency rate for these numbers is lower than 
implied by the CASRO rate calculation, we do not recommend using this assumption in the response rate 
calculation. The CASRO rate is 72 percent. 

The conservative and liberal response rates define the lower and upper bounds of the response 
rate. The conservative response rate is computed assuming that all of the numbers with unknown 
residential status are actually residential numbers. The conservative rate is 69 percent. The liberal rate is 
computed assuming that all the numbers with unknown residential status are actually nonresidential. The 
liberal rate is 77 percent. 

For general purposes, it is reasonable to say that the Screener response rate is estimated to be 
between 69 and 77 percent, and that the best estimate is 73 percent. The variability in the estimates arises 
because it is not possible to identify precisely the residential status for each telephone number. 

An experiment involving the screening of households was conducted in the NHES:95. In this 
experiment, a sample of 4,040 telephone numbers was randomly selected and a different screening 
interview was conducted with the household. This interview was called the Expanded Screener because it 
included all the items for the regular screening interview along with additional questions about the 
household and its members. One of the key concerns about adding these questions at the time of 
screening was its impact on the response rate. Table 2 shows the results of the experiment by the type of 
screening interview. The distribution of responses for the Expanded Screener and the regular Screener 
were very similar, and the overall response rates are virtually identical. Accordingly, the interview data 
collected in the Expanded Screener households are treated without distinguishing them from the regular 
household screening data in the subsequent tables. 



Table 3 provides a further breakdown of the participating and nonparticipating residential 
telephone numbers. The participating numbers are classified by whether or not any extended interviews 
were scheduled for the household and the nonparticipating numbers are classified by the reason for 
nonresponse. Extended interviews were scheduled for 70 percent of the screened households, a much 
higher percentage than in previous NHES studies, which typically involved sampling persons for extended 
interviews from only one-third of the sampled households. The increase in the percentage of households 
with extended interviews was largely the result of the Adult Education component and its sample size 
requirements. 

About 84 percent of all the nonresponse in the screening interview was due to an adult household 
member refusing to answer the screening items. This rate of refusal is the same as the NHES:91 and 
higher than the NHES:93 rate of 68 percent. Since the NHES:91 and NHES:95 addressed the same 
topics, it is feasible to suppose this is the reason for the NHES:95 rate being similar to the NHES:91 but 
different from the NHES: 93. The next largest category is the 9 percent classified as maximum calls, 
which includes those households that never completed the Screener after numerous calls. While these 
households never explicitly refused to participate, potential respondents were not available to complete the 
screening items despite many attempts to reach them. Language problems account for 5 percent of 
nonresponse. The language problem cases are discussed in more detail below. 

Table 4 shows the number of households in which at least one extended interview was scheduled. 
Nearly two-thirds (65 percent) of the households had only Adult Education interviews scheduled, 11 
percent had only Early Childhood Program Participation interviews, and 24 percent had both types of 
interviews. In the NHES:91, 38 percent of the households had only Adult Education extended interviews, 
54 percent had only Early Childhood Education interviews, and 8 percent had both types of interviews. 

Profile of Screener Response Rates 

In most RDD surveys, it is difficult to obtain and examine the characteristics of those households 
that do not respond to the screening interview. Consequently, the ability to examine nonresponse bias at 
this stage of the survey is limited. To address this concern, we have associated characteristics that are 
available in the list-assisted sampling frame with the telephone numbers sampled for the NHES: 95. The 
characteristics are those of the geographic area (the ZIP Code that has the most households associated with 
telephone numbers in the exchange) based on the 1990 Census of Population. 

Table 5 gives the distribution of the telephone calls and the estimated response rate by the 
characteristics of the areas. For example, the response rate in areas with less than 11 percent of the adult 
population having a college degree (as of the 1990 Census) had a response rate of 76 percent, while areas 
with 26 percent or more college graduates had a response rate of 70 percent. The differences in the rates 
are generally relatively small. The response rates ranged from 60 percent to 80 percent across all the 
characteristics examined. 

This univariate profile of Screener response rates by the characteristics of the areas is difficult to 
interpret because there are so many characteristics to consider. In addition, some of the characteristics are 
correlated, and the univariate profile does not explore these relationships. Consequently, a multivariate 
analysis was performed to examine the interrelationship of the characteristics and the response rates. 

The goal of the multivariate analysis was to determine if any groups of households had extremely 
low response rates. Nonresponse bias in the estimates may appear when the characteristics of the 



respondents and nonrespondents are different. By identifying groups with different response rates, the 
characteristics of the respondents and nonrespondents can be used as a indicator of the potential for 
nonresponse bias. The characteristics of the geographic areas corresponding to the telephone numbers 
sampled were used to identify groups with different response rates. The variables included in the analysis 
were all the variables that were available and thought to be correlated with the response rate. 

The analysis was done using a categorical search algorithm called CHAID. This algorithm is very 
similar to the continuous search algorithms LISREL and AID (Automatic Interaction Detector) which have 
been used for a number of years, but it is designed especially to handle categorical data like that available 
for the NHES:95. The procedure works by dividing the entire data set into cells by attempting to 
determine sequentially the cells that have the greatest discrimination with respect to the response rates. In 
other words, it attempts to divide the data set into groups so that the response rate within cells is as 
constant as possible and the response rate between cells is as different as possible. This automatic 
procedure was done by specifying that the minimum number of households in any group had to be greater 
than or equal to 500. 

An example may help to explain the methods used in CHAID. All of the characteristics in the 
model are tested and the one with the response categories having the largest discrimination with respect to 
the response rates is identified. Looking at table 6, which contains the results of this analysis, the first 
column indicates that Metro status was the variable chosen as most indicative of differential response rates 
and all five response categories for this variable were retained. Note that within Metro status response 
category four, no other splits were created, so this category, MSA in its own county, is one of the 28 cells 
created. Within the other Metro status response categories, the data were tested and Census division was 
used to split the data, with different combinations of Census divisions for each Metro status category. The 
process continued until the final 28 cells shown in the table were formed. The table is formatted so that 
the order of the column variables closely corresponds to the order in which they entered the model. 

Since many of the variables in the CHAID model, such as Census division, have multiple response 
categories, the program must take this into account. The CHAID software does this in two ways. First, it 
allows the data set to be split into more than one subgroup at a time. For example, Census divisions are 
split differently within different Metro status response categories. Second, the procedure follows a 
relatively complex procedure to check all binary splits of the data and equalize the chance of selecting 
variables irrespective of the number of response categories that variable may have. 

The results of the analysis are given in table 6. As noted above, each cell was constrained so that 
it contained at least 500 observations. The completion rates in the last column of the table, that is, the raw 
counts of the number of participating households divided by the number of households (participating and 
not participating), vary from about 66 percent to 86 percent in the 28 cells. 

The first question that needs to be addressed is whether or not the variability in response rates by 
cells is large. One way of looking at this problem is to consider what could be expected if 28 cells were 
defined randomly rather than by trying to maximize the difference in response rates. Forming random 
cells with as few as 500 cases and given the overall response rate of 73 percent, it would not be unusual to 
find a range in the response rates across the cells from 69 to 77 percent (which are the conservative and 
liberal response rates shown in table 1). Comparing this with the observed range of 66 to 86 percent 
suggests that the variation in the response rates from the CHAID model that attempts to maximize 
variation in response is not extreme. In fact, the response rates are perhaps even less variable across the 



cells than might have been expected given the goal of maximizing the discrimination. No other patterns 
are obvious from the results of the CHAID analysis. 

The general conclusion from the multivariate analysis is that no groups with extreme response 
rates were identified based on the geographic characteristics data. This is an indicator that the response 
bias may not be large for these characteristics. While these findings are important and positive, they do 
not imply the estimates are free of nonresponse bias. Clearly, some nonresponse bias exists, but these 
results suggest that it may not be large. The final sampling weights do adjust somewhat for differential 
nonresponse across geographic areas (see section on weighting), but it is unclear how effectively these 
adjustments reduce the bias. 



Another observation that sometimes indicates problems in telephone surveys is the comparison of 
the percentage of households or persons eligible from the survey to the percentage eligible from other data 
sources, such as the Current Population Survey (CPS). Estimates from the October 1992 CPS showed 
that 23.8 percent of households had children eligible for the ECPP (13.5 percent with exactly one child 
and 10.3 percent with two or more children). The percentage of households in the NHES:95 that had 



children eligible for the ECPP was 24.3 percent (13.9 percent with exactly one child and 10.4 percent 
with two or more children). In addition, the average number of adults per household in the NHES:95 was 
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CPS estimates are so similar to those from the NHES:95, it is unlikely that the composition of the sampled 
households was subject to a large nonresponse bias in the NHES:95. 



This type of analysis can be extended to better understand the nature of the potential nonresponse 
bias from the screening of households by comparing the general characteristics of the households from the 
completed NHES:95 to the same characteristics from the CPS. Table 7 gives household and person 
distributions from all 45,465 completed households from the NHES:95 and from the March 1994 CPS. 
The NHES:95 counts were based on the number and characteristics of all persons enumerated in the 
household, but 761 persons were excluded because of missing data for the age or sex of the person. The 
NHES:95 estimates were based on weights created at the household level before adjusting for 
nonresponse. The household and person characteristics examined were those thought to be correlated 
with nonresponse, based on prior methodological literature. 

In terms of household composition, households with only one member and households with older 
adults are often the most difficult to survey. The table shows that the percentage of 1-person households 
enumerated in the NHES:95 was 2.1 percent less than the CPS estimate. Breaking these households out 
by sex, the majority of the difference appears to be in the 1-person households with a female member. 
The percentage of households with at least one adult aged 65 years or more is also lower (2.7 percent) in 
the enumerated NHES:95 than the CPS estimate. These results are consistent with the hypothesis that 
these households are less likely to participate in surveys than other types of households. It also suggests 
that the NHES:95 estimates may be somewhat biased due to these differences, although the sampling 
weights for the components were adjusted for some of these characteristics, such as age. The weighting 
procedures are described later in this report. 

The second part of the table shows the percentage distribution of persons from the two surveys by 
age. The largest differences are for persons 10 to 19 years old and for persons 60 years or more. The 
difference for the older persons is related to the household distribution mentioned above. It may also 
reflect reporting errors in the NHES:95. Some respondents may fail to include grandparents if they 
believe that the interviewer is only concerned with the nuclear family. The over-representation of persons 



10 to 19 years old may be related to the fact that the NHES:95.is a survey about education. Households 
with no members currently in school may think the survey does not apply to them and respond at a lower 
rate than those in households with school-age children. However, there is not a large difference in the 
numbers of children under 10-years-old. 

None of the comparisons reveal any striking differences between the respondents to the NHES:95 
and the general population. The results do show important differences that may result in biases in some of 
the estimates from survey. We suspect that the differences discovered here may be very typical of the 
results from previous NHES surveys, but these data are not available for comparison purposes. 

Language Problem Resolution 

The NHES: 95 was conducted in English and in Spanish. The questionnaires were translated into 
Spanish, a Spanish version of the CATI instrument was programmed, and bilingual interviewers were 
trained to complete the interview in either English or Spanish. 

When a telephone number is dialed in an RDD survey, the telephone may be answered by 
someone who does not speak English. These contacts are typically coded by interviewers as "language 
problem" cases and classified as contact with a person with a hearing or speech problem or one who 
speaks a language other than English. If the respondent speaks a language other than English and the 
interviewer recognizes the language, the language is also recorded by the interviewer. 

In the NHES:95, all cases classified as a language problem, including those with hearing and 
speech problems, were placed in a separate work category so that only trained, bilingual interviewers 
could access them for follow-up calls. If a bilingual interviewer encountered a Spanish-speaking 
respondent in the initial contact, the interviewer immediately began to conduct the interview in Spanish. 
These cases were coded as having been worked in Spanish but were not classified as having been 
language problem cases. 

Language problem cases include a wide range of situations that result in a non-English-speaking 
person (or a speech or hearing impaired person) answering the telephone. For example, some households 
have members who speak English and other members who do not. In this case, the classification of the 
household as a language problem may depend on who answers the telephone for a specific call. Another 
possibility is that all household members speak English, but the telephone might be answered on some 
occasions by a person who does not live there and does not speak English. A second call to the household 
might be answered by an English-speaking household member. The procedures followed in the NHES: 95 
to ensure that all cases classified as language problems had the greatest chance of being completed are 
described in Design, Data Collection, Interview Timing, and Data Editing in the 1995 National Household 
Education Survey (Collins et al. forthcoming). 

The results for Screener interviews that were ever classified as having a language problem are 
presented in table 8. The first section gives the results for those cases ever classified as hearing or speech 
problems. The second and third sections of the table concern language problem cases other than hearing 
or speech problems. The second section includes cases in which the interviewer reported that the 
respondent in the initial household contact was speaking Spanish. The third section includes cases in 
which the initial interviewer reported that the respondent was speaking a language other than Spanish or 
English. It should be noted that the interviewers were not trained to recognize the language of the 
respondent; they were merely asked to record what they thought the language spoken might have been. 



There were 359 Screeners that were classified by at least one interviewer as a hearing or speech 
problem. About one-fourth of these cases were eventually completed, either because another household 
member answered the phone or because the interviewer initially misclassified the case. Of the 100 
completed Screeners in this group, 9 were completed in Spanish. 

The response rate for the 1 ,633 cases classified by the initial interviewer as Spanish-speaking was 
slightly higher than the overall rate for the Screeners. About 80 percent of all these cases were finalized 
as completes. Nearly 95 percent of these cases were completed in Spanish, indicating the initial 
interviewers did an excellent job identifying the language spoken by the respondents as Spanish. 

The last section of table 8 shows that the completion rate for the 706 cases identified as speaking 
some language other than English or Spanish was only about 28 percent. A low completion rate for these 
types of cases was expected since the interview was conducted only in English and Spanish. Of the 
completed Screeners in this class, the number completed in English was about twice as large as the 
number completed in Spanish. 
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During the screening interview, all household members were enumerated. This procedure differed 
from the NHES:93 screening, in which only the households with an eligible child were enumerated, 
because all adults were eligible for the NHES:95 AE component. After the enumeration, the sample of 
children and adults within the household was selected for the ECPP and AE components. For the sampled 
children, the person who was the most appropriate respondent for each sampled child was identified 
(nearly always a parent, and most often the child's mother) and became the respondent for the interview. 
For sampled adults, the interview was conducted with the sampled person directly with no exceptions. 

Table 9 presents the number of children enumerated, the number sampled, and the final status of 
each of the sampled children for ECPP, along with the estimated completion and response rates. Of the 
enumerated 17,166 children eligible for sampling in the ECPP. component, a sample of 15,781 children 
was selected. Since the study design precluded conducting more than two ECPP interviews in the same 
household, some eligible children were not sampled. About 1 percent of the sampled children were not 
actually in the age and grade range for the survey as determined by the extended interview respondent. 
These children were classified as ineligible. Complete interviews were obtained for 14,064 of the 
sampled children for an estimated 90 percent completion rate. When multiplied by the Screener response 
rate, the overall response rate for the ECPP interview is 66 percent. 

The number of adults enumerated, number sampled, and the final status of each sampled adult for 
AE are also given in table 9. About 30 percent of the 78,763 enumerated adults were sampled for the AE 
interview. The adults were sampled at different rates depending upon the response given in the screening 
interview about their education level (those who did not complete high school were sampled at a higher 
rate than those who did) and their recent involvement in adult education activities (those involved in adult 
education were sampled at a higher rate than those who were not). Almost all of those sampled were 
eligible for the interview; those classified as ineligible were either in the military or currently enrolled in 
high school. In all, 19,722 interviews were completed with the sampled adults: 11,713 of the adults 
interviewed had participated in some adult education in the last 12 months and 8,009 had not participated. 
The estimated completion rate for the AE survey is 80 percent and the response rate is 59 percent. 



The bottom section of table 9 gives the numbers for the AE splice sample. In the splice 
methodological sample, one adult was sampled per household in order to compare the estimates with those 
from the NHES:91. Adults were sampled randomly without regard to their education or status of 
involvement in adult education. A total of 3,569 adults completed the splice interview, 1,600 as 
participants and 1,969 as nonparticipants in the last 12 months. The estimated AE splice completion rate 
is 87 percent and the overall response rate is 64 percent. 

The reasons for nonresponse for the various components are presented in table 10. Respondent 
refusal to complete the interview, the main reason for nonresponse, accounted for about 70 percent of all 
nonresponse in the ECPP, AE, and AE splice sample. The only other large contributor to nonresponse 
was our inability to contact households due to respondents not answering the telephone despite multiple 
attempts, telephones being disconnected, or respondents being . temporarily away from home or sick. 
Language and other miscellaneous problems accounted for less than 10 percent of the total nonresponse. 

The completion rate for the ECPP component (see table 9) was relatively high. The rate is 
approximately the same as the NHES:93 completion rate for the School Readiness Screener component 
that included children from age 3 through the second grade. That is, despite the lower response rate in 
the NHES:95, the completion rate among parents of sampled children remained at about the same level as 
in the NHES:93 The NHES:95 was the first in the NHES series to include children from birth to age 3, 
so there is no comparable group for the youngest children. 

The AE completion rate for the NHES: 95 was 80 percent compared to the 85 percent for the 
NHES:91 AE interview. The importance of a relatively brief and straightforward interview is apparent 
when the completion rates for the NHES:95 AE interview and for the very brief NHES:95 AE splice 
sample are compared. The difference is 7 percent, clearly showing that the longer interview does have a 
negative impact on completion rates during the NHES: 95. However, the completion times for the 
NHES: 95 AE interview and the NHES:91 AE interview were quite similar — for the NHES: 95, the 
average administration time for AE participants was 16.8 minutes compared to 16.0 minutes for 
NHES:91; for nonparticipants the times were 9.5 and 7.4, respectively. 

Table 11 shows the number of households sampled for the NHES: 95 and the distribution of 
households by the number of interviews sampled for each component. Only about 20 percent of all 
households, and 30 percent of households with any extended interviews, had more than one interview 
scheduled. Multiple interviews per household were also done in the NHES:91; 43 percent of households 
with any extended interviews had more than one person sampled for an interview. While the resulting 
numbers of interviews per household are not directly comparable, it is unlikely that multiple interviews 
per household led to the decrease in the response rate. 

Profile of Extended Interview Completion Rates 

The extended interview completion rates can be examined by variables available for both 
respondents and nonrespondents. The four variables available for the ECPP are census region (based on 
the telephone number), sex of the sampled child, age of the sampled child, and grade (if enrolled in 
school) of the sampled child, and all but the first were collected during the Screener. Table 12 shows the 
number of sampled children by response status and completion rate for each of these variables. The 
completion rates are remarkably consistent across all the levels of the four variables. The range of 
completion rates is from 88 to 91 percent, except for the 82 percent completion rate for 10-year-olds, 



which is based on a relatively small number of sampled children. The lack of variation in the completion 
rates is a positive indication that no serious response bias exists at the extended interview level. 

For the AE interviews, five variables obtained in the Screener about each sampled adult are 
available for examining the response profile: census region, sex, age, high school diploma status, and 
involvement in adult education for the sampled adult. The number of cases for these variables and the 
completion rates are shown in table 13. The completion rates for region, age, and sex vary somewhat, 
but the rates by education level and status of involvement in adult education are even more variable. 
Those sampled adults with a high school diploma were much more likely to have responded, as were 
those who reported involvement in adult education activities. These highly variable rates could be 
indicative of potential bias. To reduce the bias in the estimates, nonresponse adjustment groups based on 
the classification of the sampled adults by education level and adult education involvement status were 
used in producing the weights for estimation. This procedure is especially important for the AE 
component because the overall response rate is lower for the AE component than for the ECPP 
component. 

The proportion of adults classified by education level and status of involvement in adult education 
from the NHES:95 can be compared to the estimates from the October 1992 CPS, the most recent CPS 
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percent low-education nonparticipants, 22.0 percent high-education participants, and 59.0 percent high- 
education nonparticipants. Thus, 19.0 percent were low-education and 23.1 percent were participants in 
the CPS data. The percentages from all enumerated adults in the NHES:95 were 1.7 percent low- 
education participants, 13.5 percent low-education nonparticipants, 36.3 percent high-education 
participants, and 48.7 percent high-education nonparticipants. From the NHES:95, 15.2 percent were 
estimated as low-education and 38.0 percent as participants. The NHES:95 percentages are based on 
unweighted counts of the number of persons enumerated. In other words, these are the percentages from 
all completed households, not just those sampled for extended interviews. 

The estimates from the 1992 CPS and the NHES:95 are very different, largely because 
participation was measured differendy. The item asked in the NHES:95 Screener was global and did not 
specify all types of participation. This is the only item available for all enumerated adults. 

The CPS and NHES:95 estimates for low education were 19.0 percent and 15.2 percent, 
respectively. This difference might be the result of nonresponse bias, different interviewing methods, the 
fact that the CPS estimates were collected in a supplement, or the fact that the NHES:95 is restricted to 
persons living in telephone households. Even after the final AE weights are applied, the estimated 
proportion of adults in the NHES:95 who did not have a high school diploma is 15.7 percent, the 
percentage from the NHES:91 is the same, 15.7 percent. Research conducted for the 1989 field test of 
the NHES showed that telephone coverage is a serious problem for the dropout population, and 
adjustments to correct for coverage bias are not entirely satisfactory (Brick et al. 1992). 

The difference between the proportions involved in adult education (24 percent in the CPS and the 
weighted estimate of 44 percent in the NHES:95 (38 percent is the unweighted estimate)) are much more 
likely to be the result of the ways the interviews were conducted (including training of interviewers, 
sponsorship of the study, and mode of data collection 1 ) rather than the nonresponse or coverage bias. 



1 The NHES is conducted using random-digit-dialing and telephone interviewing only. The CPS is conducted using a sample of 
dwelling units; about two-thirds interviews are conducted in person, and about one-third are conducted by telephone. 



This conclusion is consistent with the findings from the NHES:91, in which differences between NHES 
and CPS rate were also observed; see Measuring Participation in Adult Education (Collins et al. 
forthcoming) for further information on the differences discussed above. The difference between the 
participation rates is much larger than any other difference found in these analyses. 

Table 14 gives the number of adults sampled for the AE splice sample by the response status and 
completion rates. Since education level and participation status were not asked in the screening interview 
for the splice sample, the table only gives the distribution by the other three variables (census region, sex, 
and age). As with the regular AE sample, females were more likely to respond than males, and the 
completion rate for those 65 years old or older was lower than that for younger adults. It is quite likely 
that the participation and education patterns observed for the regular AE sample also persisted in this 
sample, but this notion cannot be evaluated because those data were not collected. Fortunately, the 
response rate for the splice sample was considerably higher overall (87 percent), so the potential bias due 
to differential nonresponse was lower in this sample where the nonresponse adjustment groups could not 
be based on education level or participation status. 



Unit Response 



Tables 1 - 14 



Table 1. -Number of telephone numbers dialed, by residential status and weighted Screener response rate 



Screener response category 


Number 


Percentage of 
all numbers 


Percentage of 
residential 
numbers 


Total 


120,459 


100.0 




Identified as residential 


59,713 


49.6 


100.0 


Participating 


45,465 


37.7 


76.1 


Not participating 


14,248 


11.8 


23.9 


Identified as nonresidential 


54,131 


44.9 




Unknown residential status 


6,615 


5.5 




Screener response rates* 


Rate (Percent) 


Weighted response rate 

(using business office method) 




73.3 




CASRO response rate 




72.4 




Conservative response rate 




69.0 




Liberal response rate 




76.6 





All the response rates use the weighted number of participating households as the numerator. The denominators vary but are all 
estimated totals: for the estimated response rate using the business office method, the proportion of unknown residential status 
numbers included in the denominator was based upon the proportion identified in checks with telephone business offices; for the 
CASRO (Council of American Survey Research Organizations) response rate, the proportion of unknown residential status 
numbers included in the denominator was based upon the residency rate for the numbers with known residential status; for the 
conservative response rate, all of the unknown residential status numbers were included; for the liberal response rate, none of the 
unknown residential status numbers were included. 

NOTE: Because of rounding, details may not add to totals. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, National Household Education Survey 

(NHES), spring 1995. 



Table 2.— Number of telephone numbers dialed, by residential status, type of Screener, and weighted 
Screener response rate 



Type of Screener and response category 


Number 


Percentage of all 
numbers 


Percentage of 
residential numbers 


Expanded Screener 








Total 


4,040 


100.0 




Identified as residential 


1,962 


48.6 


100.0 


Participating 


1,478 


36.6 


75.3 


Not participating 


484 


12.0 


24.7 


Identified as nonresidential 


1,884 


46.6 




Unknown residential status 


194 


4.8 




Regular Screener 








Total 


1 1ft 410 


inn r\ 




Identified as residential 


57,751 


49.6 


100.0 


Participating 


43,987 


37.8 


76.2 


Not participating 


13,764 


11.8 


23.8 


Identified as nonresidential 


52,247 


44.9 




Unknown residential status 


6,421 


5.5 




Screener response rates* 


Rate (Percent) 


Total 




73.3 




Expanded Screener 




73.2 




Regular Screener 




73.3 





All these response rates are weighted and use the business office method of allocating unresolved telephone numbers to residential 
status in the denominator of the rate. 



SOURCE: U.S. Department of Education, National Center for Education Statistics, National Household Education Survey 

(NHES), spring 1995. 
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Table 3.— Number and percentage of telephone households, by weighted Screener response status 



Screener response category 


Number 


Percent 


Participating residential phone numbers 


45,465 


100.0 


Households with no extended interviews 

scheduled 


13,727 


30.2 


Households with at least one extended 

interview scheduled 


31,738 


69.8 


Nonparticipating residential phone numbers 


14,248 


100.0 


Refusals 


11,932 


83.7 


Language problems 


736 


5.2 


Maximum calls 


1,277 


9.0 


Other problems 


303 


2.1 



SOURCE: U.S. Department of Education, National Center for Education Statistics, National Household Education Survey 

(NHES), spring 1995. 
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Table 4. -Number and percent of participating households, by type of interviews scheduled 



Type of interview scheduled 


Number of 
households 


Percent 


Total 


31,738 


100.0 


Only Early Childhood Program Participation 


3,531 


11.1 


Only Adult Education* 


20,696 


65.2 


Both Early Childhood Program Participation and 

Adult Education 


7,511 


23.7 



These numbers include households in the Adult Education splice methodology sample. Of the 20,696 households with only Adult 
Education interviews scheduled, 3,079 households were in the splice sample; of the 7,511 households with both types of interviews 
scheduled, 1,003 were in the splice sample. 



SOURCE: U.S. Department of Education, National Center for Education Statistics, National Household Education Survey 

(NHES), spring 1995. 



Table 5. -Number of telephone numbers dialed in the Screener, by response status, weighted response rate, and 
characteristics of the geographic area based on the telephone exchange 



Characteristic 


Total 


Residential, 

participating 


Residential, not 
participating 


Non-reside ntial 


Unknown 
residential status 


Weighted" 
response rate {%) 


Total 


120,459 


45,465 


14,248 


54,131 


6,615 


73.3 


Census division 














New England 


5,520 


2,033 


668 


2,427 


392 


71.4 


Mid-Atlantic 


17,634 


6,485 


2,584 


7,269 


1,296 


68.4 


East North Central 


18,418 


6,944 


1,991 • 


8,557 


926 


75.3 


West North Central 


6,843 


2,739 


601 


3,199 


304 


79.3 


South Atlantic 


23,861 


9,276 


2,588 


10,816 


1,181 


75.2 


East South Central 


6,475 


2,894 


634 


2,751 


196 


79.9 


West South Central 


14,424 


5,446 


1,628 


6,665 


685 


74.4 


Mountain 


6,200 


2,470 


725 


2,688 


317 


74.3 


Pacific 


20,380 


6,974 


2,766 


9,365 


1,275 


68.4 


Alaska/Hawaii 


704 


204 


63 


394 


43 


72.0 


Minority concentration 














High 


62,984 


22,631 


7,614 


29,284 


3,455 


71.5 


Not high 


57,475 


22,834 


6,634 


24,847 


3,160 


74.3 


Percent college graduates 














Less than 1 1 percent 


37,045 


14,018 


3,770 


17,586 


1,671 


76.5 


11 to 25 percent 


58,368 


22,629 


7,388 


25,235 


3,116 


72.9 


26 percent or more 


25,046 


8,818 


3,090 


11,310 


1,828 


70.1 


Percent black 














Less than 10 percent 


71,298 


27,444 


8,510 


31,320 


4,024 


73.4 


10 to 19 percent 


17,296 


6,402 


2,153 


7,655 


1,086 


72.6 


20 percent or more 


31,865 


11,619 


3,585 


15,156 


1,505 


73.5 


Percent Hispanic 














Less than 10 percent 


81,376 


31,852 


9,076 


36,174 


4,274 


74.7 


10 to 19 percent 


15,127 


5,271 


2,104 


6,843 


909 


68.4 


20 percent or more 


23,956 


8,342 


3,068 


11,114 


1,432 


69.6 


Percent with children under 18 














Less than 15 percent 


4,558 


1,029 


483 


2,604 


442 


60.8 


15 to 29 percent 


93,460 


35,535 


11,293 


41,382 


5,250 


73.2 


30 percent or more 


22,441 


8,901 


2,472 


10,145 


923 


76.3 


Median income 














Less than 328,000 


41,359 


15,285 


3,936 


20,169 


1,969 


77.0 


$28,000 to $38,000 


39,589 


15,458 


4,938 


17,150 


2,043 


73.7 


$38,000 or more 


39,511 


14,722 


5,374 


16,812 


2,603 


70.1 


Percent owner occupied 














Less than 56 percent 


38,418 


12,224 


4,551 


19,140 


2,503 


68.8 


56 to 70 percent 


43,786 


17,607 


5,397 


18,614 


2,168 


74.0 


71 percent or more 


38,255 


15,634 


4,300 


16,377 


1,944 


75.3 
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Table 5. -Number of telephone numbers dialed in the Screener, by response status, response rate, and by 
characteristics of the geographic area based on the telephone exchange— Continued 



Characteristics 


Total 


Residential 

participating 


Residential, not 
participating 


Non-residential 


Unknown 

residential 

status 


Weighted 

response 

rate(%) 


Percent renters 














Less than 34 percent 


54,890 


22,539 


6,251 


23,355 


2,745 


75.4 


34 to 50 percent 


39,774 


15,340 


4,996 


17,404 


2,034 


72.7 


51 percent or more 


25,795 


7,586 


3,001 


13,372 


1,836 


66.7 


Metropolitan status 














In county in central city 


51,490 


18,461 


6,462 


23,727 


2,840 


71.3 


In county not in central city 


20,146 


7,698 


2,672 


8,624 


1,152 


71.6 


Subcounty of MSA 


21,188 


8,531 


2,593 


8,883 


1,181 


73.6 


MSA in its own county 


5,755 


2,051 


800 


2,480 


424 


67.3 


Not MSA 


21,880 


8,724 


1,721 


10,417 


1,018 


80.1 



The estimated response rate is the number of completed interviews divided by the sum of the number of completed interviews, nonresponses, and 
40.5 percent of the unresolved telephone numbers, weighted by the probability of selection. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, National Household Education Survey (NHES), spring 1995. 
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Table 6.--Weighted Screener response rates, by cells formed from area characteristics 



Cell 


Metro 

status 


Census division 


Percent 

Hispanic 


Percent 

low 

income 


Median 

years 

education 


Percent 

with 

children 


Percent 

renters 


Median 

income 


Percent 

black 


Percent 

owner 

occupied 


Percent 

college 

graduate 


Weighted 

completion 

rate 


1 


1 


ne,enc,sa,wsc,m 


0-9 


0-20 
















75.5 


2 


1 


ne,enc,sa,wsc,m 


0-9 


21 + 
















77.3 


3 


1 


ne,enc,sa,wsc,m 


10-19 




0-12 














69.1 


4 


1 


ne,enc,sa,wsc,m 


10-19 




13 + 














74.7 


5 


1 


ne,enc,sa 


20+ 


















69.6 


6 


1 


w$c,m 


20 + 






0-29 












75.0 


7 


1 


wsc,m 


20 + 






30+ 












80.4 


8 


1 


ma,p,ah 










0-50 


S0-37K 


0-19 






77.0 


9 


1 


ma,p,ah 










0-50 


S0-37K 


20 + 






67.0 


10 


2 


ma,p,ah 










0-50 


$38K+ 








68.2 


11 


2 


ma,ah 










0-50 


S38K+ 








78.1 


12 


2 


P 










0-50 


S38K+ 








69.7 


13 


1 


ma,p,ah 










51 + 








0-10 


72.9 


14 


1 


ma,p,ah 










51 + 








11 + 


66.2 


15 


1 


wnc, esc 




















80.2 


16 


3 


ne,ma,m,p,ah 
















0-55 




67.0 


17 


3 


ne,ma,m,p,ah 






0-12 










56-70 




77.0 


18 


3 


ne,ma,m,p,ah 






13 + 










56-70 




68.1 


19 


3 


ne,ma,m,p,ah 
















71 + 




76.5 


20 


3 


enc,wnc,sa,esc,ws 










0-33 










79.7 


21 


3 


enc,wnc,sa,esc,ws 










34 + 










76.9 


22 


4 






















72.0 


23 


5 


ne,wnc,ah 




















86.4 


24 


5 


ma, enc, wsc 














0-9 


0-70 




86.3 


25 


5 


ma, enc, wsc 














0-9 


71 + 




81.8 


26 


5 


ma, enc, wsc 














10 + 






79.4 


27 


5 


sa,esc,m 




















84.1 


28 


5 


P 




















77.6 



Category codes: Metro status: 1 = in county in central city; 2 = in county not in central city; 3 = subcounty of MSA; 

4 = MSA in its own county; 5 = not MSA. 

Census division: ne = New England; ma = Mid-Atlantic; enc = East North Central; wnc = West North Central; 

sa = South Atlantic; esc = East South Central; wsc = West South Central; m = Mountain; 
p = Pacific; ah = Alaska/Hawaii. 

SOURCE: U.S. Department of Education, National Center for Education, Statistics, National Household Survey (NHES), spring 1995 
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Table 7. -Percentage distribution for household and persons from the NHES:95 and the March 1994 CPS 



Characteristic 


NHES: 95 
Screener 


March 1994 CPS 


Difference 


Household composition 








1 -person 


22.3% 


24.4% 


-2.1% 


1-person, female 


13.1 


14.6 


-1.5 


1 -person, male 


9.2 


9.8 


-0.6 


With person 65 years or older 


20.9 


23.6 


- 2.7 


Persons age 








0 years 


1.1 


1.5 


-0.4 


1 year 


1.3 


1.6 


-0.3 




1 C 


1 C 


r\ r\ 


✓ 

3 to 5 years 


4.7 


4.7 


0.0 


6 to 9 years 


6.3 


5.9 


0.4 


10 to 19 years 


15.7 


14.2 


1.5 


20 to 29 years 


14.2 


14.5 


-0.3 


30 to 39 years 


16.7 


17.0 


-0.3 


40 to 49 years 


14.8 


13.8 


1.0 


50 to 59 years 


9.4 


9.2 


0.2 


60 or more years 


14.2 


15.8 


-1.6 


0 to 9 years 


15.0 


15.4 


-0.4 


16 to 19 years 


6.2 


5.4 


0.8 


65 or more years 


10.6 


11.9 


-1.3 



NOTE: Weighted estimate from the NHES:95 are based on the household weight, not adjusted for non response. 

SOURCES: U.S. Department of Education, National Center for Education Statistics, National Household Education Survey 

(NHES), spring 1995. U.S. Bureau of the Census, Current Population Survey, March 1994 (unpublished tabulations). 
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Table 8. -Language problem Screener interviews, by response status 



Problem 


Number 


Percent 


Hearing/Speech Problems 






Total 


359 


100.0 


Completed in English 


91 


25.3 


Completed in Spanish 


9 


2.5 


Refusals 


103 


28.7 


Language Problems 


145 


40.4 


Other 


11 


3.1 


Identified as Spanish-speaking Problems 






Total 


1,633 


100.0 


Completed in English 


57 


3.5 


Completed in Spanish 


1,243 


76.1 


Refusals 


171 


10.5 


Language Problems 


146 


8.9 


Other 


16 


1.0 


Identified as Other Language Problems 






Total 


706 


100.0 


Completed in English 


138 


19.5 


Completed in Spanish 


63 


8.9 


Refusals 


76 


10.8 


Language Problems 


425 


60.2 


Other 


4 


0.6 



SOURCE: U.S. Department of Education, National Center for Education Statistics, National Household Education Survey 

(NHES), spring 1995. 
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Table 9. --Number of enumerated children and adults, completed interviews, and weighted completion and 
response rates, by type of extended interview 



Type of interview 


Number 


Weighted 

completion 

rate 


Weighted 

response 

rate 


Early Childhood Program Participation 








Enumerated 


17,166 






Sampled 


15,781 






Ineligible 


208 






Nonresponding 


1,509 






Complete 


14,064 


90.4 


66.3 


Adult Education 








Enumerated 


78,763 






Sampled 


24,538 






Ineligible 


569 






Nonresponding 


4,247 






Complete 


19,722 


80.0 


58.6 


Completed as participant 


11,713 






Completed as nonparticipant 


8,009 






Adult Education Splice 








Enumerated 


7,767 






Sampled 


4,060 






Ineligible 


68 






Nonresponding 


423 






Complete 


3,569 


87.3 


64.0 


Completed as participant 


1,600 






Completed as nonparticipant 


1,969 







SOURCE: U.S. Department of Education, National Center for Education Statistics, National Household Education Survey 

(NHES), spring 1995. 
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Table 10.-- Reasons for extended interview nonresponse, by type of interview and final status 



Interview type and final status 


Number 


Percent 


Early Childhood Program Participation 






Total 


1,509 


100 


Refusal 


1,078 


71 


Not available or not reached 


334 


22 


Language problem 


53 


4 


Other 


44 


3 


Adult Education 






Total 


4,247 


100 


Refusal 


2,862 


67 


Not available or not reached 


1,053 


25 


Language problem 


198 


5 


Other 


134 


3 


Adult Education Splice 






Total 


423 


100 


Refusal 


302 


71 


Not available or not reached 


83 


20 


Language problem 


24 


6 


Other 


14 


3 



SOURCE: U.S. Department of Education, National Center for Education Statistics, National Household Education Survey 

(NHES), spring 1995. 



ERIC 



27 



Table 11. -Number of households sampled for the NHES:95, by the number and type of extended 
interviews scheduled 



Number sampled for 
Early Childhood 
Program Participation 


Number sampled for Adult Education 


Adult Education 
Splice Sample 


Total 


0 


1 


2 


i 


Total 


41,383 


17,258 


23,612 


513 


4,082 


0 


31,344 


13,727 


17,293 


324 


3,079 


1 


5,747 


2,013 


3,624 


110 


555 


2 


4,292 


1,518 


2,695 


79 


448 



NOTE: The number of interviews scheduled differs slightly from the numbers in Table 9 and other tabulations because these 
include some persons who were sampled in a household and then were determined to be members of different households. A total 
of 100 sampled persons from the regular Adult Education sample, 22 persons from the Splice Adult Education sample, and 1 

sampled person from the. Parly Childhood Program Participation sample are included in this tahle fat the household level! hilt not 

included in other tabulations (at the extended person level). 

SOURCE: U.S. Department of Education, National Center for Education Statistics, National Household Education Survey 

(NHES), spring 1995. 
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Table 12.— Number of sampled Early Childhood Program Participation interviews, by response status 
and weighted completion rates 



Early Childhood Program 
Participation interviews 


Total 


Participating 


Nonresponse 


Ineligible 


Weighted 

completion rate (%) 


Total 


15,781 


14,064 


1,509 


208 


90.4 


Census region 

Northeast 


2,892 


2,569 


286 


37 


90.2 


Midwest 


3,406 


3,063 


302 


41 


91.1 


South 


5,731 


5,131 


523 


77 


90.7 


West 


3,752 


3,301 


398 


53 


89.4 


Sex of child (Screener) 












Female 


7,591 


6,775 


. 741 


75 


90.4 


Male 


8,113 


7,240 


763 


110 


90.6 


Unknown 


77 


49 


5 


23 


90.3 


Age of child (Screener) 












0 


1,244 


1,023 


99 


122 


91.0 


1 


1,382 


1,243 


136 


3 


90.5 


2 


1,715 


1,560 


146 


9 


91.5 . 


3 


1,675 


1,508 


165 


2 


90.6 


4 


1,785 


1,614 


166 


5 


90.9 


5 


1,778 


1,592 


182 


4 


89.9 


6 


1,775 


1,585 


. 185 


5 


89.5 


7 


1,684 


1,512 


170 


2 


90.7 


8 


1,709 


1,538 


160 


11 


90.6 


9 


847 


760 


81 


6 


90.2 


10 


92 


68 


13 


11 


S1.6 


Unknown 


95 


61 


6 


28 


90.9 


Grade of child (Screener) 












Not enrolled 


6,690 


5,919 


599 


172 


91.0 


Nursery /Preschool 


2,023 


1,818 


203 


2 


90.1 


Kindergarten 


1,835 


1,647 


186 


2 


90.0 


1st grade 


1,728 


1,536 


189 


3 


89.4 


2nd grade 


1,664 


1,492 


168 


4 


90.4 


3rd grade 


1,805 


1,622 


160 


23 


90.8 


Other* 


36 


30 


4 


2 


88.1 



*"Other" included special education and ungraded. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, National Household Education Survey 

(NHES), spring 1995. 
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Table 13. —Number of sampled adults for Adult Education interviews, by response status and weighted 
completion rates 



Adult Education interviews 


Total 


Participating 


Nonresponse 


Ineligible 


Weighted 
completion 
rate (%) 


Total 


24,538 


19,722 


4,247 


569 


80.0 


Census region 












Northeast 


4,578 


3,589 


920 


69 


76.5 


Midwest 


5,181 


4,315 


778 


88 


83.2 


South 


9,345 


7,477 


1,613 


255 


79.9 


West 


5,434 


4,341 


936 


157 


80.3 


Sex (Screener) 












Female 


13,062 


10,915 


1,956 


191 


83.1 


Male 


11,433 


8,785 


2,282 


366 


76.7 


Unknown 


43 


22 


9 


12 


73.4 


Age (Screener) 












Less than 20 years 


1,003 


815 


97 


91 


87.7 


20 to 34 years 


8,262 


6,624 


1,283 


355 


82.3 


35 to 49 years 


8,350 


6,924 


1,339 


87 


81.8 


50 to 64 years 


4,100 


3,230 


843 


27 


77.1 


65 or more years 


2,823 


2,129 


685 


9 


74.0 


High school diploma 
(Screener) 












Yes 


20,590 


17,120 


3,427 


43 


81.3 


No 


3,948 


2,602 


820 


526 


72.5 


Participant (Screener) 












Yes 


14,355 


11,890 


2,039 


426 


84.4 


No 


10,183 


7,832 


2,208 


143 


77.4 



NOTE: The numbers contained in this table are only for those adults sampled for the regular Adult Education interview. Adults 
sampled for the splice sample are excluded. 



SOURCE: U.S. Department of Education, National Center for Education Statistics, National Household Education Survey 

(NHES), spring 1995. 
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Table 14 . --Number of sampled adults for Adult Education Splice interviews, by response status and 
weighted completion rates 



Adult Education 
Splice interviews 


Total 


Participating 


Nonresponse 


Ineligible 


Estimated 
completion 
rate (%) 


Total 


4,060 


3,569 


423 


68 


87.3 


Census region 












Northeast 


745 


647 


92 


6 


85.7 


Midwest 


846 


765 


72 


9 


88.8 


South 


1,583 


1,389 


158 


36 


88.2 


West 


886 


768 


101 


17 


85.7 


Sex (Screener) 












Female 


2,208 


2,016 


176 


16 


90.5 


Male 


1,841 


' 1,547 


245 


49 


83.7 


Unknown 


11 


6 


2 


3 


68.1 


Age (Screener) 












Less than 20 years 


118 


94 


11 


13 


90.6 


20 to 34 years 


1,219 


1,095 


95 


29 


89.8 


35 to 49 years 


1,319 


1,173 


127 


19 


88.5 


50 to 64 years 


713 


636 


74 


3 


87.0 


65 or more years 


691 


571 


- 116 


4 


79.1 



SOURCE: U.S. Department of Education, National Center for Education Statistics, National Household Educntion Survey 

(NHES), spring 1995. 
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1995 National Household Education Survey 
Item Response and Imputation 



Introduction 

In the NHES:95, as in most surveys, the responses to some data items were not obtained for all 
interviews. There are numerous reasons for item nonresponse. Some respondents do not know the 
answer for the item or do not wish to respond for other reasons. Some item nonresponse arises when an 
interview is interrupted and not continued later, leaving items at the end of the interview blank. Item 
nonresponse may also be encountered because responses provided by the respondent are not internally 
consistent and this inconsistency is not discovered until after the interview is completed. In these cases, 
the items that were not internally consistent were set to missing (“not ascertained”). 



Methodology 

For most of the data items collected in the NHES:95 the item response rate was very high. For 
the ECPP questionnaire, the median response rate for imputed items was 98.8%; the median item 
response rate for imputed items on the AE questionnaire was 98.5%. Item response rates for those 
variables on the public release file are given in tables 1 and 2 for the ECPP component and in tables 5 and 
6 for the AE component. These tables present the items needing imputation and the items not needing 
imputation, respectively. Tables 3 and 7 provide listings of items that were manually imputed and the 
percent of imputed values that were manually imputed for the ECPP and AE components, respectively. 
Tables 4 and 8 contain listings of the ECPP and AE variables with more than 25 responses and response 
rates less than 90 percent. Note that response rates for items pertaining to income, earnings and amount 
paid for child care are lower than for other items. Items that are rarely asked, e.g. less-than weekly child 
care arrangements, may involve unusual situations where the circumstances are less amenable to being 
collected in the standard set of questionnaire items. In many of these rarely asked items, one or two 
missing values could result in a low item response rate. 

Despite the overall high item response rate, virtually all data items with missing data were 
imputed for the public release file. The exceptions were Adult Education items created to match 
employers who supported adult education activities with the employment segments (i.e., BSEMPSEG, 
CEMPSEG1-CEMPSEG3, ESEMPSEG, WEMPSEG1-WEMPSEG6). In cases in which the employer was 
not named, these variables were assigned codes indicating that matching names were not provided by the 
respondent. Imputation was done for two reasons. First, complete responses were needed for variables 
used in developing the sampling weights. Second, users will be computing estimates using a variety of 
methods and complete responses should aid their analyses. Character string variables, such as employer 
names, countries of origin, languages, or “other, specify” responses were not imputed. These character 
string variables do not appear on the public use data file, but may be obtained through a special licensing 
agreement with NCES. 



2 Imputation for course codes had not been completed as of the writing of this paper. 
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A hot-deck procedure was used to impute missing responses. In this approach, the data file was 
sorted into cells defined by characteristics of the respondents. These characteristics, or boundary variables, 
were used to group respondents into those most likely to have the same response for the data item to be 
imputed, i.e., the responses of the persons were associated with the variables used to sort the file. Two 
types of boundary variables were used. “Hard” boundary variables were considered to be so important that 
the donor and the recipient were required to match exactly. For other sort variables, called “soft” boundary 
variables, the values did not have to match exactly. In effect, the hard boundary variables were matching 
variables and the soft boundary variables were used to order the cases within the matching variables. The 
WESDECK software was used to implement the hot-deck imputation procedure. 

For variables which were sometimes skipped, a “trigger” variable was included as one of the hard 
boundary variables. The trigger variable ensured that the skip pattern in the questionnaire was maintained. 
The trigger variable could be either a single variable, or a set of conditions that determines whether the 
respondent is eligible for the particular question, i.e. whether the variable in question should be imputed or 
skipped. If skipped, the variable was set equal to -1 (inapplicable) if it wasn’t already equal to -1 prior to 
running WESDECK. If the variable needed imputation, any -1 values were set equal to -9 (missing) prior to 
running WESDECK, so that WESDECK would recognize them as missing values. 

After sorting into cells defined by the boundary variables, the observations were divided into two 
groups within the cell depending on whether or not the item was missing. The donors consisted of 
observations with complete data for the item; recipients were observations for which the item was missing. 

Whenever a case with a missing value was encountered, the value of the data item from a randomly 
selected donor within the same cell was imputed for the missing item. A donor could be used at most three 
times. This method is called a hot-deck procedure because donors are selected from the current data set, as 
opposed to some pre-defined set of allowable values. The distribution of each variable before and after hot- 
deck imputation was reviewed to ensure that the imputed data did not significantly alter the distribution. 

For each data item that was imputed, an imputation flag variable was created. If the response for the 
item was imputed, then the final imputation flag was set equal to a value between 1 and 4, where a 1 
indicates hot-deck imputation without any preliminary recoding necessary, 2 indicates hot-deck imputation 
with preliminary recoding from -1 to -9, and 3 indicates hand imputation. 

The imputation flag was set to 4 when the original response was -8 (“don’t know”) in the ECPP 
questionnaire for the variables HSKIDS, HSEDUC, HSGOVT, HSPARAD, HSTEST, HSPHYSEX, 
HSDENTAL, HSDISABL, HSSICK, RCKIDS(n), REDUC(n), RCSICK(n), NCKIDS(n), NCEDUC(n), 
NCSICK(n), CPKIDS(n), CPEDUC(n), CPGOVT(n), CPARADV(n), CPTEST(n), CPHYSEX(n), 
CPDENTA(n), CPDISAB(n)L, and CPSICK(n) 3 . This flag was set so that users can consider “don’t know” 
responses to these items separately from other nonresponse. For values that were not imputed, the 
imputation flag was set to zero. The flag enables users to identify imputed values and the method of 
imputation used. The user can then delete the imputed values, use alternative imputation procedures, or 
account for the imputation in computation of the reliability of the estimates produced from the data set. 



3 The designation (n) means that a question appears repeatedly on the data file, for example, RCSTRYR(n) gives the starting 
year for each relative care arrangement reported. 



